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FOREWORD 


This  paper  presents  an  application  of  a  generalized  inverse 
to  a  particular  mathematical  programming  problem,  the  modular 
design  problem.  It  is  designed  to  illustrate  the  simplification  that 
can  often  result  by  transforming  a  given  problem  into  a  more  con¬ 
venient  form.  In  particular  the  use  of  a  generalized  inverse  in 
making  such  a  transformation  is  emphasized. 

The  results  of  this  paper  are  closely  related  to  the  work  of 
A.  V.  Fiaceo  and  G.  P.  McCormick  of  RAC  on  nonlinear  program¬ 
ming.  In  addition  the  method  of  separable  convex  programming 
under  linear  equality  constraints  deve!  ,  ed  by  J.  E.  Falk  of  RAC 
is  used  in  the  solution  of  the  transformed  problem. 
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ABSTRACT 


It  is  shown  that  the  modular  design  problem 
minimize 


I  V,  1  2, 

■  -1  |  1 

subject  to 

y.  ;i-r.. 

y , .  *  0  i  I ....  m.  |  -  I . n. 

can  be  transformed  into  a  problem  of  minimizing  a  separable  convex  func¬ 
tion  subject  to  linear  equality  constraints  and  nonnegativities.  This  trans¬ 
formation  is  effected  by  using  a  generalized  inverse  of  the  constraint 
matrix.  Moreover  the  nature  of  the  functional  and  the  constraints  of  the 
separable  problem  are  such  that  a  good  starting  point  for  its  solution  can 
be  obtained  by  solving  a  particular  transportation  problem.  Several  pos¬ 
sible  methods  for  solving  the  separable  problem  are  discussed,  and  the 
results  of  our  computational  experience  with  these  methods  are  given.  It 
is  also  shown  that  the  modular  design  problem  can  be  viewed  as  a  special 
case  of  a  large  class  of  general  engineering  design  problems  that  have 
been  discussed  in  the  literature. 
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INTRODUCTION 


The  problem  to  be  considered  is  the  following: 
minimize 


r,E.)  (I  d,  D,> 


subject  to 


i  *  i 


ii 


I  I. 


F(.  I),  iO. 


I 


(0) 


In  Eq  0  it  is  assumed  that  e,  ,  d,,  R,,  are  constants  such  that  e,  >  0,  d,  >  0, 

R  a  0,  for  all  i ,  and  i  and  E, ,  n,  are  the  variables.^  Using  the  transforma¬ 
tions  y,  *  f,  E,  i-  1,  .  .  .  ,  n,  xf  ■  it  D,,  j  ■  1,  .  .  .  ,  n  and  r,.  *  e,  d,  Rl( 
i  »1,  .  .  .  ,m  j  >1 . n  the  problem  can  be  written  in  the  <orm: 


minimize 


subject  to 


i  »,  I  x, 
•  i  ,i 


»,*|2r.|  i-l. 


I  -  l. 


m 

n 


(i) 


x,zo. 


where  r1(  are  constants  such  that  r((  *  0  for  all  i  and  j.  In  Eq  1  it  can  be  as¬ 
sumed  that  y ,,  z j  are  strictly  positive  without  ioss  of  generality  ilnce  for  one 
of  these  to  be  zero  it  is  necessary  for  a  row  or  column  of  the  fr,,)  matrix  to  be 
zero,  and  if  this  were  so  that  row  or  column  and  Its  corresponding  variable 
could  be  dropped  from  the  problem. 

Equation  0,  or  equivalently  Eq  1,  may  be  called  the  modular  design  problem. 
This  problem  was  first  suggested  by  Evans.1  In  his  paper  Evans  presented  an 
algorithm  for  solving  the  problem  that  “converges  rather  slowly"  to  the  optimal 
solution.  He  also  comments  that  the  algorithm  “can  be  made  to  converge  much 
faster  if  one  makes  intelligent  guesses  in  the  trial  tol  on  phase;  however 
there  is  apparently  no  way  to  program  this  last.*' 

This  paper  shows  that  the  constraints  y,,  >  0,  where  strict  inequality 

exists,  permit  Eq  1  to  be  transformed  into  a  problem  of  minimizing  a  convex 
function  subject  to  linear  inequalities.  Then  a  generalized  inverse  is  used  to 
effect  a  second  transformation,  which  yields  a  problem  in  the  form  of  minimiz¬ 
ing  a  separable  convex  function  subject  to  linear  equality  constraints  in  non¬ 
negative  variables. 

The  achievement  of  a  problem  involving  a  separable  convex  functional 
means  that  direct  contact  is  established  with  the  computing  routines  of  linear 
tFor  an  illustration  of  a  situation  where  such  a  problem  arises  the  reader  is  re¬ 
ferred  to  Itef  1. 
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programming  by  recourse  to  suitable  piecewise  linear  approximations.  A  dis¬ 
cussion  of  such  a  technique  is  given  in  Chap.  X  o/  Charnes  and  Cooper’s  Man¬ 
agement  Models  and  industrial  Applications  of  Linear  Programming2  and  in 
various  references  cFed  therein. 

Moreover  the  nature  of  the  functional  and  the  constraints  of  the  separable 
problem  are  such  that  a  good  starting  point  for  its  solution  can  be  obtained  by 
solving  a  particular  distribution  problem.  Since  mere  are  extremely  ellicient 
algorithms  for  .solving  such  problems  an  initial  solution  can  be  quickly  obtained, 
thus  eliminating  one  of  the  major  difficulties  discussed  by  Evans.1 

Finally  it  is  shown  that  Eq  0  is  a  member  of  a  large  class  of  engineering 
design  problems  that  have  been  considered  in  several  research  papers  pro¬ 
duced  at  Northwestern  University  and  Westinghouse  Research  Laboratories. 

MATRIX  THEORY 

Definition.  Let  A  be  any  m  ■  n  matrix. 

Then  any  n  .  m  matrix  A"  such  that  A  A”  A  \  will  be  called  a  generalized 
inverse  of  A. 

A  generalized  inverse  is  unique  if  and  only  if  A  is  square  and  nonsingular. 
It  can  also  be  shown  that  A"  is  a  generalized  inverse  of  A  if  and  only  if  \  -  Awf> 
is  a  s  dution  of  AX  -  b,  whenever  AX  -  b  is  consistent.  Further  properties  of  V 
can  be  found  in  papers  by  Rao  and  by  Charnes  and  Kirby. 7»B 

Lemma  1.  A  necessary  and  suflicient  condition  that  the  matrix  equation 
AX  -  b  be  consistent  is  that  AA"b  -  b 

Proof.  Suppose  that  AA“b  -  b.  Then  X  ►  A“b  is  a  solution  of  AX  -  b,  implying 
the  consistency  of  A\  -  b 

Conversely  suppose  that  AX  -  b  is  consistent.  Then 

i>  \\=3\\"h  wu\\  n  i) 

Lemma  2.  Let  *  =  l  X  |  AX  >  r  j . 

Let  O  =  t.  to  |  to  ?  0,  AA*  (c  *■  to)  :  c  +  to  ) . 

Then  Xr  ■£.  there  exists  an  to  such  that  AX  -  c  *■  to  and  to  c  O . 

Proof.  Let  Xr 

Let  x  s  \ X  - 1 ,  so  that,  for  any  X,  to  is  uniquely  defined. 

Then  to  -  0  as  X  c  ♦  T.  AX  •  c .  Also  by  this  definition  of  x  AX  -  c  *  x.  But 

by  lemma  1,  AX  -  i  *u)  1  AA*  (c  k  to)  -  c  *  x.  So  that  for  any  Xr  $  the  x 

defined  by  to  -  AX  -  c  satisfies  to  r  Q  and  AX  c  +  to. 

Conversely  for  any  torn  ,  AAW  (c  *■  to)  =  r  *  to,  which  by  lemma  1  implies 

there  exists  X  such  that  AX  =  c  *  to  is  consistent.  Also  tor  ii  Xto  •  0,  hence 
AX  =  c  f  to  z.  AX  •  i .  Thus  for  any  tor  f) ,  there  exists  an  X  (which  is  not 
necessarily  unique)  such  that  \X  c  *  to  and  Xr  4'. 

Therefore  if  AX  ■  c  are  the  constraints  of  some  mathematical  program¬ 
ming  problem,  this  problem  can  be  transformed  into  an  equivalent  one  whose 
constraints  are  AX  -  r  ♦  to,  A  A”  (c  *  to)  =  c  *  to,  and  to  •»  0,  providing  the 
following  pair  of  equivalent  programming  problems, 
optimize 

PM 


4 


subject  to 


\\  >( 


and  optimize 


ff\> 


subject  to 

AX  c  ♦  o» 

\  \  *  ((  *  *<>)  (  ♦  w 

w  >0. 


The  added  constraints  AA*  (c  ♦  co)  =  c  *  co,  <o  «  0  in  this  second  problem 
ensure  that  only  vectors  co  of  “slack  variables”  for  which  the  system  AX  » 
c  *  co  is  consistent  will  be  considered. 

The  reason  why  such  consistency  conditions  are  not  mentioned  in  most 
linear  programming  texts  is  that  A  is  assumed  to  be  an  matrix  of  rank 

m  .  Since  it  can  be  shown  that  AA*  ■  I,  the  m  x  m  identity  matrix,  if  and  only  if 
A  has  full  row  rank.t  it  can  be  seen  that  when  A  has  rank  m  the  constraints  AA* 
(c  ♦  co)  *  r  ♦  co  become  c  *■  co  *  c  *  co;  thus  they  are  redundant  and  can  be 
ignored. 


MODULAR  DESIGN  PROBLEM 


In  the  constraints  of  Eq  l,y,  >  0,  ;  >  0  i*  1 . |  *  1,  .  .  .  ,  n. 

Since  these  are  strict  inequalities  the  following  change  of  variables  can  be 
made: 

1.0)1,  e  i  ~  1 . m 

Let  t'1  1*1 . »» 


where  are  unrestricted  variables.  T 

minimize 

S  e"  i  / 

i*l  i * i 

subject  to 

1-1.. 

This  is  equivalent  to 
minimize 

hi  n 

1  i  eH,i 

i*l |*l 

subject  to 

i  i. 

where  cl(  *  In  (r,,)  i 

*  1»  •  •  •  *  **»  i  *  • 

(2) 


Since  it  is  possible  that  some  r,,  =0,  the  value  of  -  *>  is  an  admissible 
value  for  c^.  Whenever  c(|  =  -  «°,  the  constraint  u,  ♦  i>j  *  c„  is  redundant 


tFor  a  proof  see  Ref  7,  lemma  1. 
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corresponding  to  any  constraint  of  Eq  1  of  the  form  y  ( z  j  *  0  being  redundant 
as  y,,  z,  >  0.  A  procedure  for  avoiding  the  computational  difficulties  that  arise 
in  dealing  with  the  quantity  -  *>  will  be  given  later. 

The  constraint  set  of  Eq  2  can  be  written  in  matrix  form  as  AX  *  c,  where 


*  ■'“l . “ . . . . . '  J 

and  the  am  *  (m  ♦  s  )  matrix  A  ■  («ri),  r  ■  I, .  .  .  , mn ,  s  *  1,  .  .  .  ,  »+«  has  the 
following  properties: 

W  •*■♦!.  *♦!  *  *  1  I,  ....  * 

k  •  0.  .  .  .  ,  m  - 1 


k  -  0 . m  -  1 


and  all  remaining  a,$  are  zero.t’1 

Let  ta)  be  the  mn  <  1  vector  defined  by 

. “In . “ll . “l» . 


). 


Then  using  the  results  of  the  previous  section  Eq  2  can  be  replaced  by  the 

following  equivalent  problem: 

minimize 

m  m 

i  i  »“•**’» 

< - i i-i 

subject  to 

AX ■ c *u 

AA*  (c  .  u)  =  c  +  aj  (3) 

to  >  o. 


From  definitions  of  A,  X,  c,  and  <*>  it  can  be  seen  that  AX  =  c  *  u>  can  be 

written  as  U|  -►  i/,  ■  c(j  ♦  <*),,  for  all  i,  i  .  Thus  the  sj ,  i  *1 . .  v,t  j  «1, 

.  .  .  ,  a  can  be  eliminated  from  Eq  3  and  rewritten  as 
minimize 

2  2 

<•1  I  *  I 

subject  to 

AA**  (c  ♦  c>)  *  {  *  gj 

to  >0. 

where  the  constraints  of  Eq  4  guarantee  that  ii,,  i>,  exist  that  satisfy  u,  *  v,  = 
c,j  ♦  u),j  and  iif  ♦  v,  *  c . 

In  other  words  Eq  4  can  be  solved  for  u>(, ,  the  optimal  values  of  ,  i  *1^ 
...,*,  j>l,...,n,  and  then  the  system  of  linear  equations  u,  ♦  v.  =  c(,  +■&,. 
I>1,...,ri|*1(...,ii  can  be  solved  to  obtain  u*.  r*  the  optimal  values  of 
“if  •  alf...  ,  m  and  v  j  t  |  =1».  .  .  *  n . 

Moreover,  because  A  has  a  specific  form  one  of  its  generalized  inverses 
can  be  characterized  in  the  following  manner:  Let  A*  *  (o»  ),  *-l,  .  .  .  ,  m  ♦  n, 
r  *1,  .  .  .  ,  mn;  then  A*  is  such  that 

tin  this  characterization  of  A  it  is  assumed  that  *,  »  *  2.  If  *  =  1,  or  "  -1,  or 
both,  the  problem  is  trivial. 
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I  •  2, ....  ■ 

k  -  1,  1 

and  all  remaining  aj_r  ,  s  »1, .  .  .  ,  •  ♦  r  *1, .  .  .  ,  sm  will  be  zero.  It  can 
be  shown  that  fP  defined  above  does  Indeed  have  the  property  that  AA*  A  -  A. 

Using  thlsAJ*  and  the  study’s  characterization  of  A,  AA"  can  be  computed 
and  finally  (I-AA*),  where  I  is  the  urn  x  *m  identity  matrix.  If  T  is  defined  ■ 


(I  -  AA"  )  then  the  n  xn  matrix  T 
the  following  properties: 

"  (*pV»  P  ‘ 

.  ,mr,  q-1, 

.  .  .  ,  as  has 

1  *  1 

k-1.  .  .  . 

.  a-U-I .  .  . 

.  s 

fc-  ll  •  •  . 

.  a-l  l-X  .  .  . 

.  s 

W**  '»■ ♦  1.  kail 

fc-  1*  •  .  . 

.  ■-!,  I-X  .  .  . 

. " 

(i,)  ka«la  1 

fc-l..  • . 

.  s 

(■)  • 


1. 1 


-l 


(i0  1 
(in)  i,  k„  +  |  -  1 


and  all  remaining  t_  ,,  p,  q,  =1,  .  .  .  ,  «n  will  be  zero. 

Finally  replacing  the  constraints  AA"  (c  ♦  u:)  «  c*  u>  of  Eq  4  by  (I  —  AA* ) 
a)  3  -  (I  -  AA*  )c  and  using  the  study’s  characterization  of  T  Eq  4  can  be  written 

as 

minimize 

X  i  -  I  X 

(•I  (■!  1*1  |  - 1 


subject  to 


1.1  *  l.l  *  c  1 1  *  c  1.1  *  <k*l,l  “f*  ♦  l.l 


fc-l,  I-X  ....  ■  (5) 

t)|(  >0l>l . m  |*| . n 


The  first  objective,  which  was  to  write  Eq  0  in  the  form  of  minimizing  a  sep¬ 
arable  convex  function  subject  to  linear  equality  constraints  in  nonnegative 
variables,  has  now  been  accomplished. 


DUAL  DISTRIBUTION  APPROXIMATION 

Prior  to  discussing  various  ways  of  solving  Eq  5,  how  to  obtain  an  initial 
feasible  solution  quickly  will  be  shown.  Since  in  Eq  2  it  is  required  that  s,  ♦  vt 
>  c  ||,  and  at  the  same  time  it  is  desired  to  minimize  E  f_,  E". ,  em>  4  v>  it  is  ex¬ 
pected  that  the  optimal  solution  will  have  m,  ♦  v,  <*  c((.  Thus  the  initial  feasible 
solution  will  be  obtained  by  using  the  approximation 

tu*+vi  mt‘*t  .,a* ♦' “)-*•< 


-  «*'•  (1  ♦  M|  ♦  If | 

In  other  words  e"*  4  vi  “  c>l  is  going  to  be  approximated  by  the  linear  part  of 
its  Taylor  series  expansion  about  zero.  Thus  a  feasible  solution  to  Eq  2  is 
obtained  by  replacing  if. ,  X". ,  t  4  ¥>  by 
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I  X  f*'1  (I  ♦  M,  ♦  I'  -C|() 
i  -  I  f  I 


■  n  an 

•  XX  ♦  X  *,  <  X 

•  •I  I -  I  I  - 1  I  - 1 


f“») 


and  then  solving  the  problem 
minimise 


subject  to 


X  «,«,♦  x  kjP, 

1-1  I  -  I 


n  m 

X  o  <  X  e“l) 
l-l  i- 1 


(6) 


where 


X  x  f‘*» 

i*i  i- 1 


■nil 


■ 

•  X 

1*1 


r'l 


•  X 

I  •  I 


rn 


■ 

*  «. 

1*1 


It 

*  X 
1-1 


V 


This  is  the  dual  of  tiie  distribution  problem 
maximise 


subject  to 


X 

I  I 


X 

1-1 


{ll  *1, 


X  »,j  *  l|  |*1 . ■ 

1-1 


X 

1-1 


*.l  -  •, 
*.»*« 


1-1 . m 

•  -1 . 


.  n. 


(7) 


Since  extremely  efficient  algorithms  exist  for  solving  distribution  problems, 

Eq  7,  and  hence  Eq  6,  can  be  solved  quickly.  If  the  optimal  values  of  ut  ,  v,  for 
Eq  6  are  denoted  by  m*,  if  ,  the  relation  uif,  3  u",  ♦  i»®  -  c,,  can  then  be  used 
to  define  the  initial  values  of  uil(  for  Eq  5. 

The  starting  point  that  is  obtained  by  this  procedure  will,  in  general, 
give  values  of  uif,  that  are  very  close  to  the  optimal  values  of  u>,j  for  some  <j. 

In  addition  if  a  solution  exists  of  the  system  h(  ♦  vt  *  ctl  i>l . s  j  ■  1, 

(Le.,  if  u>  »0  is  feasible  for  Eq  5),  this  point  will  be  optimal  for  both 
Eqs  6  and  5;  hence  the  initial  feasible  solution  will  be  optimal. 

In  any  case,  because  of  the  convexity  of  the  objective  function  of  Eq  5  in 
u? ,  j ,  the  iteration  of  this  Taylor  expansion  procedure  about  jj  °f  to  get  a  new 
dual  distribution  approximation,  and  so  on,  appears  to  be  a  possibly  worthwhile 
method  in  its  own  right  for  the  solution  of  the  modular  design  problem. 


UNIQUENESS  OF  SOLUTIONS 

As  Evans1  has  pointed  out,  the  solution  of  Eq  1  is  not  unique.  If  y* ,  z]  is 
a  minimizing  solution  for  Eq  1,  then  so  is  9  y  *,  z*/0  for  any  0  >0.  This  non- 
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uniqueness  can  be  seen  again  in  Fq  2  since  11  u*,  i  *,  optimize  Eq  2  then  so 
does  u,  *-  y,  i1 ,  -  y  for  any  constant  y. 

This  is  not  true  however  for  problem  5,  for  the  optimal  solution  of  Eq  5 

will  be  unique  If  the  function  I"„,  £"_,  r  ‘ 1 1  .  is  a  strictly  convex  function 

of  u? ,,  ,  i  1,  .  .  .  ,  m,  i  -  1,  ....  n.  A  necessary  and  sufficient  condition 
for  this  to  be  true  is  that  all  f ,,  >  -  <*,  i.e. ,  that  rl(  •  0  or  ( R ,,  >0)  for  all  i ,  i . 
Since  we  must  have  v, ,  •  0,  it  follows  that  for  any  pair  (i,i)  for  which  r,(  0 

the  constraint  v, •>  r()  will  be  redundant.  Thus  one  way  of  assuring  that  the 
functional  of  Eq  5  is  strictly  convex  is  to  replace  r(|  0  by  7t)  -  c  where  f  >  0 

is  very  small.  The  solution  of  this  perturbed  problem  will  coincide  with  the 
solution  of  Eq  5  if  f  is  very  small  in  con  pari  son  with  the  nonzero  r,,  .  1 

The  advantage  of  strict  convexity  in  the  functional  of  Eq  5  is  that  it  permits 
the  use  of  various  nonlinear  programming  routines  that  require  this  strictly 
convex  property.  Examples  of  such  algorithms  appear  in  papers  by  Falk,  Fiacco 
and  McCormick,  Rusen,  and  Charnes  and  Lemke."-13 


RELATION  TO  THE  GENERAL  ENGINEERING  DESIGN  PROBLEM 

The  transformation  from  Eq  1  to  Eq  5  shows  that  the  modular  design  prob¬ 
lem  is  simply  a  special  case  of  a  large  class  of  engineering  design  problems 
that  have  been  discussed  elsewhere  in  the  literature.  Charnes  and  Cooper1*4 
show  that  many  problems  in  determining  the  optimal  parameters  for  an  engi¬ 
neering  design  car;  be  expressed  mathematically  as  a  problem  of  minimizing 
a  separable  convex  functional  subject  to  linear  constraints.  This  is  exactly 
the  form  in  which  Eq  5  is  given. 

Moreover  Charnes  and  Cooper3  discuss  various  computational  approaches 
to  such  problems  other  than  the  methods  mentioned  above.  In  particular  they 
suggest  that  one  means  of  solving  such  problems  would  be  to  get  into  the  neigh¬ 
borhood  of  the  optimum  as  soon  as  possible  and  then  undertake  further  refine¬ 
ments  after  attaining  this  neighborhood.  This  approach  would  seem  to  be  highly 
feasible  here  because  of  the  ease  with  which  Eq  6  can  be  solved. 

Equation  0  is  also  directly  related  to  the  work  on  engineering  design  prob¬ 
lems  done  by  Duffi.i,  Peterson, and  Zener.5*6  In  their  papers  they  consider 
problems  of  the  form 


minimize 

n 

vi  '2 

1  I 

subject  to 

nk 

X  c ,  ( ° 1 1  .  .  .  I8”"  £  1  k-  1.  .  •  .  p 

1  *-  My  '  " 

1,  •  0  |  1 . 1*1 

In  Eq  8  it  is  assumed  that  c,  > 0  all  » ,  mj  *  n0  +  1,  »»2  =  "i  +  1,  .  .  .  etc.  and  a() 
are  any  real  constants. 

t  A  sufficient  condition  for  the  solution  of  the  perturbed  problem  to  be  optimal  for 
Eq  1  is  that  the  constraint  y,  2  7I(  =  f  not  be  binding,  i.e.,  y*:*  >7,,  =  c  . 
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Equation  1  can  be  written  in  this  form: 
minimize 

m  n 

^  ^  C< «  —  I »  «  *|  *!*•♦) 

•-1  I* I 

subject  to 

?  |  |  *1  <•  I 

‘■IN  ♦(!-!)  N  4-  I  *1  '«  f  I  ^ 


(9) 


where 

and 


'i  ■  y,  '-i . "* •  «•  *  *  ®  *,  i 


cmn .  (i- im  ♦  |  ri) '  •  •  •  •  I 


Duff  in,  Peterson, and  Zener  then  write  a  dual  to  Eq  8  and  proceed  to  show 
that  in  many  cases  the  solution  of  the  dual  is  much  easier  to  obtain  than  that  of 
the  primal,  Eq  8.  Using  their  duality  theory  and  a  transformation  of  the  dual 
functional  employed  by  Charnes  and  Cooper,*  which  yields  a  concave  functional, 
the  dual  of  Eq  9  is 
maximize 

MR  2  HR 

1  |  1  .  X  S,U(7,) 

I  ■  1  I  «N  «  I 

subject  to 

■IN 

x  *  i 

i  - 1 

I* 

X  1  0  I  •  I . * 

l«(l-  li«  «  I  I ♦  i  — 1> "  ♦  I 


1*1,.  .  Ml 

>0  I  M  <  1 . 2mn.  (10) 

Since  the  constraints  of  Eq  10  involve  m  ♦  n  ♦  1  equalities  and  there  are 
2  mn  variables,  there  will  be  only  one  feasible  point  for  Eq  10  if  2  mn  ■  w  +  s  + 1. 
This  will  be  true  only  when  m  •  1,  n  *  2  (or  n  -  1,  m  ■  2),  in  which  case  the  solu¬ 
tion  of  Eq  0  is  trivial  anyway.  Thus  it  #ould  appear  that  although  the  dual  to 
Eq  8  is  very  useful  for  some  engineering  design  problems  it  does  not  simplify 
the  solution  of  the  modular  design  problem. 

However,  this  method  does  have  the  useful  property  that  any  feasible  point 
for  Eq  10  yields  a  value  for  its  functional  that  is  a  lower  bound  on  the  functional 
of  Eq  0.*  Sii.ce  any  feasible  point  for  Eq  0  (in  particular  that  point  obtained  by 
solving  Eq  6)  yields  an  upper  bound  on  the  functional,  it  can  be  seen  that  one 
might  quickly  get  bounds  on  the  optimal  value  of  Eq  0  by  solving  Eq  €  and  getting 
any  feasible  solution  to  Eq  10. 


k«  I 


k  -  I 


6,  -  0 


EXAMPLE 

As  an  example  of  the  modular  design  problem  consider  the  following, 
which  appeared  in  the  Evans  paper.1  The  elements  in  Table  1  are  the  values 
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for  i  *  !,  2,  3,  4;  1  =  1,2,  3.  Then  the  corresponding  set  of  cl(  values  is  obtained 
using  the  relation  cit  *  In  (r,, ).  In  accordance  with  the  procedure  suggested 
above  =  0  is  replacedby  fp  ■  c  «  1.  This  problem  is  then  solved  and  ac 
long  as  at  the  optimum  u \  *  v3  >  1,  the  optimal  solution  to  the  problem  is 
r23  *  0. 

The  c,,  i  ,4  j  *1,2,3,  are  shown  in  Table  2. 


TABLE  1 


'll  13 

'll*23 

'13  ‘4 

fj,  -  13 

'll  *  13 

'll’0 
(Tj,  -  1) 

rJI  *  ,S 

'11  *  ” 

'13  ^ 

r«l  *  34 

'42  "  12 

'41  *  22 

TABLE  2 


C 1 1  -  2.70805 

c  1 2  •  3  13549 

C„  -3  78419 

Cfl  -  2  16495 

f  -  2.56495 

Cjj  .  0.00000 

<„  -2.70805 

c,2  *  2  83321 

<„  -  3.55535 

<4,  -  3.52636 

<42  *  2.48491 

<4J  -  3.09104 

Next  the  solution  of  Eq  6  is  obtained.  To  do  this  the  problem  is  set  up  in 
tabular  form  as  shown  in  Table  3.  The  optimal  solution  of  Eq  6  is  obtained  in 
one  pass  through  the  algorithm  given  in  (Ref  2,  pp  57-63). 


TABLE  3 


-  2.56495 

v\  -  2.56495 

vj  -3.21365 

M*  -0.57054 

2.70805 

3.13549  | 

3.78419  | 

© 

© 

nJ  -0.00000 

2.56495 

2.56495 

0.00000  1 

Qb) 

-0.34170 

2.70805  | 

2.83321  ] 

3.55535  | 

© 

■J  -0.96141 

3.52636  | 

2.48491  I 

3.09104  | 

© 

k,  -n 

^2  *  65 

k,  •  102 

In  Table  3  the  numbers  in  the  upper  left-hand  corner  of  each  box  repre¬ 
sent  the  Cjj.  The  numbers  in  circles  are  the  optimal  values  of  «,,  in  Eq  7; 
where  no  circle  appears  it  means  that  the  corresponding  optimal  i,.  is  aero. 
One  set  of  optimal  s,,  v,  are  shown  to  the  left  and  across  the  top  of  the  table. 
The  corresponding  set  of  wjj  ■  sf  ♦  v*  -  c are  given  in  Table  4. 
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Finally,  using  the  starting  point  given  in  Table  4  the  problem  is  solved 
using  the  method  developed  in  Falk's  “An  Algorithm  for  Separable  Convex 
Programming  under  Linear  Equality  Constraints.”*  The  optimal  u)l(,  u,,  i>, 
and  corresponding  optimal  values  of  y ,  z,  are  shown  in  Table  5. 

It  can  be  seen  from  the  table  that  oj^  >0  so  that  the  constraint  u2  ♦  i*i 
»  723  is  not  binding;  hence  the  above  solution  is  optimal  for  the  problem  where 
r2i  =*  0. 


TABLE  4 


*  0.42744 

0.00000 

0.00000 

-  0.00000 

0.00000 

*£,  1.21165 

wj,  0.I0H60 

«,.J2  0.07344 

o' 

1 

« 

Of* 

-  0.00000 

-  1.04145 

wjj  -  1.06402 

TABLE  5 


ij  1.84635  i  j-  I.S4S78  ij  -  2.l«tM 


iij  -  1.58071 

wj,  .  0.72801 

>;  tj  si.06 

ci|2  *  0.00000 

>;  -  71.00 

w*n  0.00000 

y|  -  24.87 

u*2 1  •  O.3Q0S7 

€..Jj  •  0  00000 

-  121365 

1.0N17 

z\  -  17.56 

yj  ij  -  13.00 

>2  24.8. 

*4,  -  0  10017 

0ij2  0.07114 

(.,j3  -  0.00000 

u*  1 .  V>087 

y*,:;  -24.71 

y*,  z\  18.20 

y\  l]  .15.00 

|  •  0.00000 

cj2  -  0.74C.18 

**^43  "  0.7B34S 

168001 

»;  ij  •  it.oo 

25. 17 

y\  rj  -  48.16 

Note  that  the  initial  starting  point  given  in  Table  5  actually  gives  seven 
of  the  variables  at  their  optimum  values.  Thus  the  solution  of  the  dual  distri¬ 
bution  approximation  does  indeed  give  a  very  good  starting  point  for  the  solu¬ 
tion  of  Eqs  2  or  5.t 

As  suggested  in  the  section  *Dual  Distribution  Approximation*  the  dual 
distribution  approximation  was  solved  a  second  time  by  approximating  u,  ♦  v, 
-  uif,  -  cl(  *  h,  ♦!!,-«*-«*  by  the  linear  part  of  its  Taylor  series  about 
zero.  The  result  was  an  improved  starting  point  (i.e.,  it  gave  a  lower  value 
of  the  objective  function  for  Eq  5  than  did  uj?,  )  and  six  of  the  resulting  u»i f 
were  at  their  optimum  values. 

tSee  Falk's  paper*  for  further  examples  and  some  results  of  computational  ex¬ 
perience  on  problems  similar  to  Eq  5. 
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